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ABSTRACT 

Kott  (1988)  first  derived  finite  population  corrections  (fpcs)  for 
the  Horvitz-Thompson  estimator  under  unequal  probabiUty  sam- 
pling without  replacement.  No  numerical  comparison  of  variances 
with  the  fpcs  was  made.  We  derive  some  of  the  fpcs  again  in  a 
new  and  more  intuitive  way  without  resorting  to  large  sampling 
theory.  We  demonstrate  how  to  incorporate  these  fpcs  with  the 
jackknife  variance  estimator  of  the  generalized  regression  esti- 
mator (Sarndal  1980).  Simulation  results  showed  that  adjustments 
by  these  fpcs  resulted  in  variances  with  considerable  less  bias. 
One  of  the  fpcs  is  also  robust. 
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Finite  Population  Corrections  of  the  Hon^itz-Ttionnpson 
Estimator  and  their  Application  in  Estimating  the 
Variance  of  Regression  Estimators 

Z.  Ouyang 
H.  T.  Schreuder 
D.  C.  Boes 


Introduction 

The  use  of  the  Horvitz-Thompson  (HT)  estimator 
( Yfj'p)  with  probability  proportional  to  size  (pps)  sam- 
pling without  replacement  (ppswor)  is  well  estab- 
lished (Brewer  and  Hanif  1983).  Brewer  and  Hanif 
(1983)  list  50  different  ppswor  procedures  but  noted 
that  with  most  of  the  procedures  the  second  order 
inclusion  probabilities  are  difficult  to  calculate.  Con- 
sequently, the  elegant  classical  variance  estimators 
of  the  Horvitz-Thompson  estimator  cannot  be  used. 
Sometimes,  a  variance  estimator  for  Ypp^  is  used  as- 
suming sampling  with  probability  proportional  to 
size  with  replacement.  But,  this  variance  estimator, 
denoted  by  v(y'^^g),  is  biased  upward  (Wolter  1985, 
Schreuder  and  Ouyang,  1992)  as  expected. 

For  a  finite  population  with  variable  of  interest  y 
and  the  following  approximate  model  for  y: 

y.=bXi+eiGi,  i  =  l,...,N,  (1.1) 

where  the  x^  are  known  positive  numbers  satisfying 
the  constraint 

N 

max    , . . . ,  jc^  ]  <  (1  /  n)^  , 

1=1 

and  n  is  the  sample  size,  the  e^  are  uncorrelated  ran- 
dom variables  with  mean  0  and  variance  1  and  each 
Oj  is  a  positive  function  of  Xj  which  may  or  may  not 
be  specified.  To  improve  on  viYpp^)  as  a  variance  es- 
timator of  Yfjj<  by  utilizing  the  information  provided 
by  the  model,  consideration  of  a  finite  population 
correction  (fpc)  is  necessary. 


The  probability  of  selecting  unit  i  in  each  draw  and 
TT-  =  np.  is  the  inclusion  probability  of  unit  i. 

Finite  Population  Correction 

Fpcs  for  the  Horvitz-Thompson  estimator  under 
ppswor  was  first  addressed  by  Wolter  (1985)  who 
suggested  using 


as  an  fpc  without  providing  justification.  Kott  (1988) 
derived  fpc  of  the  Horvitz-Thompson  estimator  un- 
der ppswor  by  replacing  the  design  variance  of  Y^y 
with  its  model  variance  and  the  design  expectation 
of  v(Yppg)  with  its  model  expectation  and  suggested 
that  their  ratio  could  be  used  as  an  fpc.  Although 
Kott's  original  fpc  is  complex,  he  derived  a  simple 
expression  for  the  fpc  by  taking  its  limit.  However, 
replacing  design  variance  and  design  expectation  by 
model  variance  and  model  expectation  is  not  easily 
justified. 

The  fpc  in  simple  random  sampling  without  re- 
placement (srswor)  is: 

\-±  =  [{N-n)/ {Nn)] [\/{N- \)^ {y,  - Y)^ / 
^  i=i 

N        _  ]  (21) 
^l/[n{N-l)]J^{y,-Yf\, 

where  the  numerator  is  equal  to  the  variance  of  y^ 
(sample  mean)  under  srswor  and  the  denominator 
is  equal  to  the  expectation  of 


1 


les 


under  srswor. 


n(n  - 1) 

is  the  variance  of  under  simple  random  sampling 
with  replacement  (srswr).  The  fpc  in  srswor  can  be 
expressed  as: 


\-j^  =  E(y,-Yf/ElvJy,)]  (2.2) 


where  v^iy^)  is  the  variance  estimator  of  y^  under 
srswr.  Using  the  fpc  in  srswor  by  (2.2)  suggests  the 
use  of 


1- 


n 


NJ 


as  a  variance  estimator  of  y^  in  srswor.  Generalizing 
this  idea  to  sampling  ppswor,  an  fpc  (denoted  by  1- 


L„J  can  be  written  as: 


l-f^^,=E(Y„^-Y)'/E(vJY^^j)  (2.3) 


where 


(2.4) 


l€S 


is  the  variance  estimator  of  Y    under  ppswr  and 


1 


n{n  - 1) 


N 


E 


lyf/pf- 

ies 

^YppsJ,yi/Pi+nY^ 


2 

pps 


les 
N 


i=l  ^  i^j 


where  Iljj  is  the  joint  probability  of  selecting  units  i 
and  j. 

The  variance  of  the  HT  estimator  is: 


i=l       ^^i  i*j  ^^i^^j 

Substituting  (2.6)  and  (2.7)  into  (2.3)  yields 


/pps 


l-ff^y.+Z.   nn  y-^' 

!=1       ^^i  i*j  ^^i'^^; 

Xy.'/n,--^iM,n,/n,n, 

1=1  iV; 


(2.8) 


The  fpc  expression  given  in  (2.8)  cannot  be  used 
directly  since  the  second-order  inclusion  probabili- 
ties on  the  right-hand  side  are  unknown.  But  if  the 
second-order  inclusion  probabilities  were  known, 
VariYjfj^)  could  be  estimated  directly  without  resort- 
ing to  the  use  of  fpc.  By  using  the  model  in  (1.1),  the 
second  order  inclusion  probabilities  in  (2.8)  are  elimi- 
nated. If  is  the  expectation  operator  under  model 
(1.1),  then: 


(2.5) 


(l-fppg)  v^^^iYppg)  can  be  used  as  a  variance  estima- 


tor of  Yfjrp  if  fppg  is  known.  This  variance  estimator 
will  correct  the  upward  bias  of  v^^{Yppg)  as  a  vari- 
ance estimator  of  Yfjj^.  Based  on  (2.3)^  ^~^pps  is  de- 
rived. The  design  expectation  of  v^^^iYpp^)  given  in 
(2.4)  is: 


EvJYpp,)  =  --^E 
n{n  - 1) 


J^(yi/Pi-Ypp,y 


les 


(2.6) 


1  fpps 


1=1  ^ 


^  1  -n  ^  n  -n n 


b  x^Xj 


X(6^xf+(Tf)/n,-4Tl^VA/n.n, 

t=l  ^      ^  i*j 


(2.9) 


2 


|:^(nf.c.f).i"^n.n 


!=1  ^^1 


tr   n,n,   -  ' 


X(n?  +ca,^)/n,  --i-Xn.nA/nA 

i=l  '^^      ^  i>; 


1=1       ^^i  1=1  i>7 

N  N  ^  N 

cX^,Vn,  +  Xn.-— rXn.> 

1=1  1=1  "      ^  i>; 


(2.9  continued) 


where 


c  =  n^/ 


r  N  \ 

V    i=l  J 


Because: 


N  N 


N 


t=l 


i=l 


(2.10) 


and 


N  N 


N  N 


In.n.=IIn,Ti,  =  In.In, 

i=l  i=l 


(2.11) 


i=l 


substituting  (2.10)  and  (2.11)  into  (2.9)  leads  to: 


N 


j=l      ^^i  1=1 
iV 

n(7i-l)-;i'+^nf 


1      fpps~  N 


i=l 


c^af/n.  +  Xn,  ^n(n-l) 

i=l  t=l  /II 

1=1  1=1  A  A- 


(2.12) 


Kott  (1988)  derived  (2.12)  for  large  n.  But  (2.12)  is 
also  good  for  smaU  n  and  the  above  derivation  is  more 
straightforward.  If  11^  is  proportional  to  of ,  then: 


1  ^ 

i-/;  =  i-iXn 


(2.13) 


Note  that 


N 


1=1 


can  be  "estimated"  by 

Xnf/n.=Xn., 

lEs  ies 

so: 


(2.14) 


Wolter  (1985)  also  suggested  using  l-f2  as  an  fpc,  even 
though  he  did  not  provide  any  rationale. 

Using  the  harmonic  mean  to  replace  the  arithmetic 
mean  in  (2.14),  a  somewhat  conservative  fpc  is: 


(2.15) 


Kott  (1988)  also  derived  fg  under  the  assumption 
af  «  rij  but  based  on  our  derivation,  if  Ilj  is  propor- 
tional to  (jf ,  then  (2.12)  gives: 


l-f^=l-n/N 


(2.16) 


as  a  finite  population  correction  directly:  l-f4  can  also 
be  estimated  by  l-fg.  Equation  (2.16)  is  an  upper 
bound  of  l-f|  because: 


f  N  \ 

(  N  \ 

Jl  = 

In. 

U=l  J 

N 


1=1 


So  (2.16)  is  also  a  conservative  fpc  compared  to  l-fj. 

Numerical  Comparison  of  the  fpc 

We  used  3  data  sets  from  forest  surveys  to  com- 
pare the  fpc  in  a  simulation  study.  The  first  data  set. 
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LOBK2,  consisted  of  1795  trees  with  variables  total 
bole  volume  in  cubic  feet  (v^)  and  tree  dianieter  at 
breast  height  squared  in  inches  times  total  height  in 
feet  (d^h).  For  each  tree  the  value  v^  was  computed 
from  the  equation: 

=-0.734  +  0.002129  d^/i+e, 

with  error  e^  approximately  distributed  as  N(0, 
a2(d2h)2),  where  (7  =  0.00001  (Schreuder  and  Ouyang 
1992).  A  very  strong  linear  relationship  existed  be- 
tween v^  and  d^h.  The  second  data  set,  NY,  consisted 
of  plot  volume  on  622  remeasured  plots  in  New  York. 
The  variables  were  gross  cubic  foot  volume  per  acre 
of  live  trees  (GAL)  at  time  t  and  t-1.  Simple  linear 
regression  of  GAL^  on  GAL^.j  was: 

GAL,  =  1053.706  +  0.5313058  GAL,_^  + 

with  R2  =  0.2156.  The  residuals  ^2  n^ight  be  roughly 
proportional  to  GAL^.^  (Schreuder  et  al.  1990).  The 
third  population  was  RG5  with  loblolly  pine  radial 
growth  data  at  2  points  in  time  (Zahner  et  al.  1989). 
A  weak  linear  relationship  existed  between  the  vari- 
ables and  the  variance  structure  of  the  dependent 
variable  y  given  x  was  unclear. 

The  entire  NY  population  and  random  samples  of 
size  500  from  population  LOBK2  and  RG5  were  used 
as  populations,  since  population  sizes  should  be 
small  for  the  fpc  to  matter.  Random  samples  totaling 
1000  of  size  30  were  drawn  from  each  population. 
The  mean  of  the  square  root  of  each  variance  estima- 
tor obtained  in  the  simulation  was  then  expressed  as 
percent  of  simulation  standard  error.  Three  unequal 
probability  sampling  strategies  were  used.  The  first 
one  was  a  stratified  sampling  from  the  cumulated 
x's  (spscx):  Sort  the  population  by  x- value.  Then  di- 
vide the  sum  of  the  x's. 


1=1 

by  the  derived  sample  size  n,  and  from  n  strata  [(XT/ 
n)  i,  (XT/n)  (i+l)l  i=0, 1, (n-1),  select  one  sample 
unit  at  random  from  each  stratum.  The  second  one 
was  very  similar  to  spscx,  except  x^^  was  used  in- 
stead of  Xj  in  forming  the  strata.  We  call  it  spscxk. 
With  the  third  method,  called  spps  sampling,  one  unit 
was  selected  from  each  stratum  with  probability  pro- 
portional to  its  X,  spscx  and  spps  used  the  same  strata. 
Only  the  third  one,  spps,  was  a  true  pps  procedure. 
The  other  2  were  included  to  determine  how  sensi- 
tive the  fpcs  were  to  the  assumption  of  yj  being  pro- 
portional to  71  J.  To  evaluate  the  fpcs: 

1 

^(n-i)tf 

i;^  =(1-/2)1;,,  v^={\-j^)v^,  ^4  =(1-/4)^./ 

were  used  in  the  simulation  study.  The  mean  square 
roots  of  the  variances  expressed  as  percent  of  simu- 
lation standard  errors  (table  1)  indicated  that  adjust- 
ing v^  by  the  fpc  usually  results  in  estimators  that 
are  less  biased  than  v^. 

Based  on  the  simulation,  v^  was  the  best  estima- 
tor. This  was  expected  for  LOBK2,  since  v^  was  de- 
rived based  on  equation  (1.1).  But  v^  was  also  best  for 
NY.  The  variance  of  the  error  term  for  NY  was  propor- 
tional to  something  between  GAI^.i  to  (GAl^_|)2.  v^  and 
V2  were  best  in  RGS,  which  suggested  that  V|  was  very 
robust.  V3  was  basically  more  conservative  than  v^  in 
aU  cases.  V3  and  V4  behaved  quite  similarly  since 

was  an  estimator  of  n/N  but  V4  tended  to  be  a  bit 
more  stable  since  1-n/N  was  a  constant.  Vi  was  simi- 


Table  1 .  Mean  square  root  of  variance  estimator  expressed  as  percent  of  the  simulation  standard  error. 


LOBK2 

NY 

RG5 

spscx 

spscxk 

spps 

spscx 

spscxk 

spps 

spscx 

spscxk 

spps 

108.02 

110.01 

117.96 

135.18 

116.54 

105.43 

106.29 

102.06 

110.77 

V, 

98.83 

100.65 

107.93 

130.24 

112.28 

101.58 

101.16 

97.14 

105.42 

^2 

98,74 

103.19 

112.39 

130.23 

112.83 

102.46 

101.17 

97.56 

106.22 

V3 

103.89 

105.80 

113.45 

131.88 

113.70 

102.97 

102.23 

98.61 

106.52 

103.89 

105.80 

113.45 

131.88 

113.70 

102.00 

102.23 

97.61 

106.53 
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lar  to  and  should  be  more  stable  than  V2  and  was  a 
somewhat  less  biased  estimator  than  V2.  In  general, 
was  the  least  biased  variance  estimator  and  the 
most  biased. 

Finite  Population  Correction 
of  a  Jocicicnife  Variance 

Estimator  for  a  Regression  Estimator 

Suppose  that  the  finite  population  satisfies  the  fol- 
lowing model: 


y^=a  +  bXi+ei,i  =  l,...,N, 


(4.1) 


where  a  and  b  are  unknown  parameters  for  all  i  and 
the  ej  are  unknown  random  variables,  with 


(4.2) 


where  denotes  tfie  expectation  operator  with  re- 
spect to  the  model,  ct^  is  an  unknown  parameter,  and 
<5j  is  a  known  or  unknown  function  of  the  known 
values  x^.  For  populations  that  satisfy  a  model  like 
(4.1),  regression  estimators  are  very  efficient  in  esti- 
mating the  population  total  Y. 

Let  s  =  {1, n}  be  the  index  set  of  the  sample.  De- 
fine: 


'yi" 

"n,       0  ■ 

yn_ 

(4.3) 


and: 


(4.4) 


Then,  a  general  regression  estimator  (Samdal  1980) 


is: 


N 


=       +J,x,b,  +  ^(3..  -  a,  -  xfi,)/n, .  (4.5) 


(4.6) 


where: 


"1  x; 

'y/ 

Ix^ 

y^. 

(4.7) 


Under  some  mild  conditions  (see  Ouyang  et  al.  1991): 
a,  =  a  A  =  h.  (4.8) 


Hence: 


E{Y^^,-Yf=  Var 


les 


y^-d-xfi 

n. 


(4.9) 


Consider  the  jackknife  variance  estimator  of  Ygrpi- 
Define  the  pseudovalues  used  in  jackkrufing  by 


where: 


N 


(4.10) 


Yia)  =  +^X,6(„)  +{n/(/l-l)} 

■  _ 

Z,(yi-^(a)-^Acz)'>/^i 


(4.11) 


les 
i=a 


and  and  6(„)  are  obtained  from  (4.4)  without  the 
a-th  observation.  Define  the  jackknife  estimator  of  Y 
by: 


(4.12) 


aes 


t=l 


and  the  jackknife  variance  estimator  of  0  by: 

v{h  =  {l/n{n- 1)}^ -tf.  (4.13) 


aes 


In  Y^j,  gr  is  the  general  regression  estimator  and  pi 
denotes  weight  11^^  to  estimate  a  and  b  in  (4.4).  Let 
the  '"census  fit"  of  a  and  b  be: 


Notice  that  under  the  condition  =  a^,  =  h^, 
and  the  condition  in  (4.8),  we  have  that  ^„  -  ^  in  (4.13) 
is  approximately  equal  to: 


5 


1^    /7CC  t&9 


=  (/i-i)X(x-a.-:^A)/n,) 


=  n{y^-a-xM/nj-J^{y^-a^-xf>,)/Yl, 
=  niy^  -a-x^b)/nj-'£(y^-a- xfi) / n, . 

ies 

(4.14) 

Thus,  the  jackknife  variance  estimator  has  the  same 
form  as  (2.4),  with  in  (2.4)  replaced  by  {y^-d-  xjb) . 
Note  that: 


(4.15) 


As  pointed  out  by  Cochran  (1977,  p.  257),  it  is  often 
assumed  in  (4.2)  that: 


5i=xfA<g<l 


(4.16) 


the  <§jS  in  (4.18)  are  different  so  that  the  fpcs  devel- 
oped for  Yjjj^  can  not  be  used  directly  to  adjust  the 
jackknife  variance  estimator  for  Ygrpi-  To  find  the 
proper  adjustment,  we  used  yi  in  (2.8)  replaced  by 
y^  -  ttg  -  Xihg .  Let  be  the  expectation  operator  un- 
der model  (4.1)  and  (4.2).  Since: 


±i   n  .  n.     '  ' 


(4.21) 


and 


1  ^  n 


r 

V 


1     ^  TT 

_J_y  _iL 


•*j    f   J  J 


=  0. 


(4.22) 


Thus,  the  finite  population  correction  factor  in  this 
case  is  approximated  by: 


or 

d^^c^x^+c^x]  (0<q,C2<l).  (4.17) 

For     =  jcf ,  we  have: 

yi-d,-  xfi,  =  ei  =  ^iXi    i  =  \,...,N,  (4.18) 

where  ~  N(0,a^)  and  (^|,...,<|^  are  independent. 
The  jackknife  variance  estimator  has  the  following 
form: 


n(n-l)±t 


^1 

n{n-l)±i 


^iyi-d,-xfi,)/ni 

-|2 


-i2 


IGS 


(4.19) 


IGS 


To  estimate  EiY^^^  -  Yf,  which  has  the  following 
form  based  on  (4.9): 


E{Y^^,-Yf  =  Var 


(4.20) 


N 


N 


£(y,-d-*i6)Vn, 


i=l 


1=1  I 

N 


N 


J^iy.-d.-xfif/n, 


i=l 


N 


i=l 


Thus,  the  fpc  can  be  used  here,  with  erf  in  (2.12)  re- 
placed by  5fy^,  and  fpc  (l-f^),  (l-f2),  (l-fg),  and  (1- 
f^)  can  also  be  used  here.  For  numerical  comparisons, 
the  3  data  sets  and  the  3  sampling  schemes  described 
in  section  3  are  used  again.  Besides  the  jackknife  vari- 
ance estimator  (denoted  by  JV)  and  the  versions  ad- 
justed by  fpc  (l-fj),  (l-f2),  (l-fs),  (l-f4)  respectively 
(denoted  by  JVl,  JV2,  JV3,  JV4),  we  also  used  the 
variance  estimators  of  Y^^j  proposed  by  Sarndal 
(1982)  and  Sarndal  et  al.  (1989). 


^  ijes 


1  ^  n,n,. 


n. 


f  - 

'A 

(4.24) 
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2^  n 


f 


n. 


n 


A  variance  estimator  of  Y^^  derived  specifically  for 
(4.25)       sampling  one  unit  per  stratum  (Ouyang  et  al.  1991), 
is  also  included  in  the  numerical  comparison.  The 
estimator  is: 


where  e,'  is  defined  as: 


'(    ^  \ 

V  s  ) 

(x-x)^x,/(n,u,) 


■(^-^)I(x-x)Xx,/(n,.,; 


(4.26) 


where: 


(4.27) 


With  all  three  sampling  schemes,  we  selected  one 
unit  per  stratum,  so  that  estimators  (4.24)  and  (4.25) 
would  be  zero.  Hence,  we  used  the  Horvitz-Thomp- 
son  form  of  these  estimators  instead: 


^  n.       rrt.  n.n. 


n.,-n,n 


(4.28) 


VS2*  =  T^-^  e;+  y  IkJMk  ^/e; .  (4.29) 


(4.30) 


where  unit  {i^J  is  the  j^th  unit  drawn  from  the  i-th 
stratum.  The  numerical  study  based  on  2000  simula- 
tions shows  (table  2)  that: 

1)  VO  provides  the  least  biased  estimates; 

2)  the  jackknife  variance  estimator  is  usually  not  as 
good  as  VSr  and  VS2*; 

3)  the  corrected  jackknife  variance  estimators  (VJl, 
VJ2,  VJ3,  VJ4)  are  usually  better  than  VSr  and 
VS2*  and  almost  as  good  as  VO; 

4)  there  is  not  much  difference  among  VJl,  VJ2,  VJ3, 
and  VJ4; 

5)  VJl  is  about  as  good  as  any  of  the  other  fpc;  and 

6)  VJ4  is  always  conservative. 

This  section  showed  that  the  fpc  developed  for  Y^^ 
can  also  be  applied  to  reduce  the  bias  of  the  simple 
jackknife  variance  estimator  of  Ygrpi  and  those  vari- 
ance estimators  work  well. 

Summary 

A  series  of  fpc  were  derived  for  sampling  ppswor. 
If  pps  with  replacement  variance  estimators  must  be 
used  for  ppswor  sampling  with  Y^^,  adjusting  by 
1-f^  in  equation  (2.13)  provides  the  least  biased  vari- 
ance estimators  for  ppswor  sampling  schemes  select- 
ing 1  unit/ stratum.  For  regression  estimator  Y^j, 


Table  2.  Mean  square  root  of  variance  estimator  expressed  as  percent  of  ttie  simulation  standard  error. 


LOBK2 

NY 

RG5 

SPSCX 

SPSCXK 

SPPS 

SPSCX 

SPSCXK 

SPPS 

SPSCX 

SPSCXK 

SPPS 

VSl 

95,50 

94.00 

94.00 

76.41 

88,56 

101.29 

93.25 

93.70 

96.43 

VS2 

95.49 

94.02 

93.98 

76.98 

89,08 

102.77 

93.60 

93.78 

96.70 

VO 

105.92 

103.68 

102.39 

79.96 

92,63 

105.97 

99.13 

99.60 

102,43 

VJ 

110.47 

105.79 

104.69 

119.28 

119.80 

120.50 

109.14 

104.70 

106,65 

VJl 

101.07 

96.79 

95.78 

114.92 

115.42 

116.10 

103.87 

99.65 

101,50 

VJ2 

100.97 

99.24 

99.75 

114.92 

115.99 

117.10 

103.89 

100.08 

102.28 

VJ3 

106.24 

101.75 

100,68 

116.37 

116.88 

117.56 

104.97 

100.70 

102.59 

VJ4 

106.24 

101.75 

100.68 

116.37 

116.88 

117.56 

104.97 

100.70 

102.58 
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applying  the  four  fpcs  to  a  jackknife  variance  esti- 
mator of  Ygrpi  results  in  estimators  with  slightly 
larger  bias  than  estimator  Vq  in  equation  (4.30)  for 
ppswor  sampling  schemes  selecting  one  unit/ stra- 
tum, but  they  are  all  generally  less  biased  than  the 
jackknife  variance  estimator  VJ  in  equation  (4.19)  or 
estimators  VSl  and  VS2  in  equation  (4.28)  and  (4.29). 
l-f^  is  recommended  as  adjustments  for  the  jackknife 
variance  estimator  of  Ygrpi  -  The  standard  fpc 

N-n 
N 

is  desirable  because  it  adjusts  variance  estimation  bias 
substantially  but  is  almost  always  conservative. 
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